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Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the application: 
Listing of Claims: 

1 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video that includes baseball based 
upon an event, wherein said event of said baseball is characterized by a start time based upon 
when the ball of said baseball is put into play in a manner free from using a model sequence of 
frames to determine the approximate frame that said ball of said baseball is put into play and an 
end time based upon when the ball of said baseball is considered out of play, where each of said 
segments includes a plurality of frames of said video; and 

(b) creating a summarization of said video that includes baseball by including 
said plurality of segments, where said summarization includes fewer frames than said video. 

2 (original). The method of claim 1 wherein said event is defined by the rules of 
baseball. 

3 (original). The method of claim 1 wherein said start time is temporally proximate a 
baseball pitch. 

4 (original). The method of claim 1 wherein said end time is temporally proximate to the 
batter missing the ball with a bat. 
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5 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, where each of said segments 
includes a plurality of fi-ames of said video, based upon a series of activities defined by the rules 
of baseball that could potentially result in at least one of: 

(i) a score; 

(ii) preventing a score; 

(iii) advancing a team toward a score; 

(iv) preventing advancing a team toward a score; 

(b) wherein said identifying is in a manner fi-ee from using a model sequence of 
fi-ames, free fi-om using an action spotting technique, and fi'ee fi'om using a pixel-by-pixel 
comparison said s e gm e nts ar e fr ee fi-om including a batt e r swinging a bat ; and 

(c) creating a sununarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

6 (original). The method of claim 5 wherein said summarization of said plurality of 
segments is in the same temporal order as said plurality of segments within said video. 

7 (original). The method of claim 5 wherein said activities are determined based upon 
the color characteristics of said video. 

8 (original). The method of claim 5 wherein said activities are determined based upon 
scene changes. 

9 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video based upon detecting a play 
of said baseball game, wherein said identifying includes detecting the start of said play in a 
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manner free from using a model sequence of frames to determine the approximate frame that a 
ball is put into play and detecting the end of said play, fiirther wherein said identifying is in a 
manner free from using an action spotting technique and free from using a pixel-bv-pixel 
comparison, where each of said segments includes a plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

10 (original) The method of claim 9 wherein said detecting the end of said play is based 
upon detecting said start of said play. 

1 1 (original). The method of claim 9 wherein said summarization identifies said plurality 
of segments of said video. 

12 (original). The method of claim 9 wherein said summarization is a summarized video 
comprising said plurality of segments excluding at least a portion of said video other than said 
plurality of segments. 

13 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, wherein the start of said 
plurality of segments is identified based upon detecting at least one region of a generally green 
color in a generallv lower region of said video and at least one two regions of a generally brown 
color in a pair of spaced apart horizontal regions where said generallv green region is between 
said horizontal regions , where each of said segments includes a plurality of frames of said video; 
and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 
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14 (original). The method of claim 13 further comprising detecting at least two regions 
of said generally green color. 

15 (original). The method of claim 13 further comprising detecting at least two regions 
of said generally brown color. 

16 (original). The method of claim 15 further comprising detecting at least two regions 
of said generally green color. 

17 (original). The method of claim 13 wherein said green color and said brown color are 
generally vertically aligned. 

18 (original). The method of claim 13 wherein said green color region and said brown 
color region have sufficient horizontal spatial extent. 

19 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, wherein the start of said 
plurality of segments is identified based upon detecting at least three regions of horizontally 
oriented regions of generallv homogenous colors including at least one of generally brown and 
generally green , where each of said segments includes a plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 



20 (original). The method of claim 19 wherein at least two of said regions have the same 
dominant color. 
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21 (original). The method of claim 19 wherein at all of said at least three regions have 
different said colors. 

22 (original). The method of claim 20 wherein said at least two regions are located on 
opposing sides of another said detected region of a different color. 

23 (original). The method of claim 19 wherein said one of said regions is generally 
brown and another of said regions is generally green. 

24 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, wherein the start of said 
plurality of segments is identified based upon identifying at least three spatial regions of 
sufficient spatial coherence and sufficient horizontal extent in a generally lower reeion of said 
video , where each of said segments includes a plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

25 (original). The method of claim 24 wherein each said at least three regions is at least 
one of substantially generally green and substantially generally brown. 

26 (original). The method of claim 24 wherein said three regions are generally vertically 
spaced apart. 

27 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video including a play , wherein 
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said identifying for at least one of said segments includes detecting the start of said segment of a 
play based upon processing of a first single frame of said video independently of other frames, 
where each of said segments includes a plurality of frames of said video; 

(b) v e rifying that said first singl e frame is an appropriat e removing said single 
frame as the start of said segment including a play based upon processing of another single frame 
temporally relevant to said first single frame independently of other frames; and 

(c) creating a summarization of said video by including said plurality of 
segments, v^here said summarization includes fewer frames than said video. 

28 (original). The method of claim 27 where in said identifying is based upon detecting 
at least one region of generally brown and at least one region of generally green. 

29 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said baseball video, wherein said 
identifying for th e start of at least one of said segments is free from using a model sequence of 
frames to d e t e rmine th e approximat e fram e that said ball is put into play , wherein said 
identifying for the end of at least one of said segments is based upon detecting a scene change, 
where each of said segments includes a plurality of frames of said baseball video; and 

(b) creating a summarization of said baseball video by including said plurality of 
segments, where said summarization includes fewer frames than said baseball video. 

30 (original). The method of claim 29 wherein said scene change is based upon a 
histogram. 

3 1 (previously presented). The method of claim 29 wherein said identifying for the start 
of at least one of said segments is based upon detecting regions of color. 

Page 7 



Appl. No. 09/934,004 

Amdt. dated October 6, 2005 

Reply to Office action of April 6, 2005 

32 (original). The method of claim 3 1 wherein at least one of said regions is generally 
brown and at least one of said regions is generally green. 

33 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said baseball video, wherein a start of at 
least one of said segments is first identified and then an end of said at least one of said segments 
is identified based upon detecting a plurality of subsequent scene changes, wherein a first scene 
change detected after said start of said at least one of said segments is firee from being selected as 
said end of said at least one of said segments, wherein a subsequent scene change detected after 
said first scene change is selected as said end of said at least one of said segments, fixrther 
wherein each of said segments includes a plurality of frames of said baseball video: and 

(a) identifying a plurality of segments of said baseball vid e o, wh e r e in said start of 
said s e gm e nt is first identified for at l e ast on e of said s e gments th e n wh e r e in said identifying for 
the end of at least on e of said s e gments is bas e d upon det e cting a plurality of scone chang e s, 
wh e r e th e first sc e ne chang e det e ct e d aft e r th e start of said at l e ast on e of said GOgmonto is fr e e 
from b e ing sel e ct e d as said e nd of said at least on e of said segments, wh e re each of said 
segments includ e s a plurality of fram e s of said baseball vid e o; and 

(b) creating a summarization of said baseball video by including said plurality of 
segments, where said summarization includes fewer frames than said baseball video. 

34 (original). The method of claim 33 wherein at said first scene change the frame is 
identified as primarily the field. 

35 (original). The method of claim 33 wherein said field is determined based upon 
detecting at least a generally green region and a generally brown region. 
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36 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video where each of said segments 
is identified as a play, where each of said segments includes a plurality of frames of said video; 

(b) identifying a plurality of said segments identified as a plav that are temporally 
separated by a sufficiently short duration; 

(c) based upon said identifying as a result of (b) conn e cting creating a modified 
continuous segment by including a portion of said video identified during said sufficiently short 
duration, an identified said segment immediately proceeding said portion, and an identified said 
segment immediately subsequent to said portion said id e ntifi e d plurality of s e gm e nts ; and 

(d) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

37 (original). The method of claim 36 wherein said cormecting includes discarding the 
frames of said video between said identified plurality of segments. 

38 (original). The method of claim 36 wherein said connecting results in a single 
segment that includes said identified plurality of segments together with the frames of said video 
between said identified plurality of segments. 

39 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, where each of said segments 
includes a plurality of frames of said video and each of said segments is identified as likely 
including a play of said basebal l such that a plurality of segments are identified as including a 
play of said baseball : 

(b) identifying at least one of said segments identified as including a plav of said 
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baseball that has a temporally sufficiently short duration; 

(c) based upon said identifying as a result of step (b) removing said identified 
segment firom said lik e ly plurality of segments: and 

(d) creating a summarization of said video by including said plurality of 
segments without said removed segment , where said summarization includes fewer frames than 
said video. 

40 (original). The method of claim 37 wherein said connecting includes discarding the 
frames of said video between said identified plurality of segments. 

41 (original). The method of claim 37 wherein said connecting results in a single 
segment that includes said identified plurality of segments together with the fi-ames of said video 
between said identified plurality of segments. 

42 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video, wherein said identifying for 
at least one of said segments includes detecting said start a start of said segment based, at least in 
part, upon processing of a frame of said video, whefe wherein each of said segments includes a 
plurality of frames of said video, fiirther wherein said processing characterizes a relative position 
of a batter and whether said batter wh e th e r a batt e r is sufficiently close to at least one of a 
catcher and an umpire proximate home base; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

43 (original). The method of claim 42 wherein said start is further detected based on at 
least one region of a generally green color and a generally brown color. 
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44 (currently amended), A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video wherein each of said 
segments includes a play of baseball; 

(b) d e t e cting identifying a commercial within said video; 

(c) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video, where at least one of 
said plurality of segments of said video that is determined to be sufficiently temporally close to 
said commercial is ar e fr ee from b e ing not included within said summarization but would have 
otherwise been included within said summarization . 

45 (original). The method of claim 44 wherein said commercial is detected based upon at 
least one substantially black frame. 

46 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video wherein each of said 
segments includes a play of basebal l wherein said identifying is in a manner firee from using a 
model sequence of frames to determine the approximate frame that said play starts, wherein said 
segments include fiiU-speed plays and slow motion plays of said fiill-speed plays , fiirther 
wherein said identifying is in a manner free from using an action spotting technique and free 
from using a pixel-by-pixel comparison : and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video, where a user may 
select from: 

(i) said summarization including only full-speed plays; 

(ii) said summarization including only slow motion plays; 
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(iii) said summarization including both full-speed plays and slow motion plays. 

47 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video wherein each of said 
segments includes a play of baseball; 

(b) creating a summarization of said video based upon analysis of a visual image 
portion of said video by including said plurality of segments, where said summarization includes 
fewer frames than said video; and 

(c) removing at least one of said segments from said summary based, at least in 
part, upon audio information related to said at least one of said segments. 

48 (original). The method of claim 47 wherein said audio information is obtained 
exclusively from a temporal analysis. 

49 (previously presented). A method of processing a video including baseball 
comprising: 

(a) identifying a plurality of segments of said video, where said identifying is 
based upon analysis of frames of said video, wherein each of said segments includes a play of 
baseball; 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video; and 

(c) modifying the duration of at least one of said segments from said summary 
based, at least in part, upon audio information related to said at least one of said segments. 



50 (original). The method of claim 49 wherein said audio information is obtained 
exclusively from a temporal analysis. 
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51 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video including a play of baseball , 
wherein the start of said plurality of segments is identified based upon detecting different spatial 
regions having generally homogenous different textures, where each of said segments includes a 
plurality of frames of said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

52 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said video including a plav of baseball , 
wherein the start of said plurality of segments is identified based upon said video being free firom 
substantial translational motion, where each of said segments includes a plurality of fi-ames of 
said video; and 

(b) creating a summarization of said video by including said plurality of 
segments, where said summarization includes fewer frames than said video. 

53 (currently amended). A method of processing a video including baseball comprising: 

(a) identifying a plurality of segments of said baseball video including a plav of 
baseball wherein said identifying for the end of at least one of said segments is based upon 
detecting a scene change, where said scene change is not used to identify said end of said at least 
one of said segments if the temporally relevant portion of said at least one said segment includes 
substantial horizontal motion, where each of said segments includes a plurality of fi-ames of said 
baseball video; and 

(b) creating a summarization of said baseball video by including said plurality of 
segments, where said summarization includes fewer frames than said baseball video. 
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54 (currently amended). A method of processing a video comprising: 

(a) providing a TV- Anytime compliant description scheme of said video 

(b) identifying a plurality of segments of said video based upon said TV- Anytime 
compliant description scheme , where said identifying is based upon analysis of frames of said 
video ; 

(c) generating another video based upon said identified segments, wherein said 
another video has less frames than said video. 

55 (original). The method of claim 54 wherein said video is transcoded in accordance 
with the channel capacity of a transmission medium. 

56 (original). The method of claim 54 wherein said video is transcoded in accordance 
with the storage capacity of a storage device. 

57 (canceled). 

58 (canceled). 

59 (currently amended). A method of providing video comprising: 

(a) a service provider remotely located from a user identifying a summary of a 

video; 

(b) a s e rvic e said service provider identifying a description of said summary; and 

(c) said service provider providing said summary and said description to a r e mot e 
said user in response to receiving a request for said summary from said remot e user. 
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60 (original). The method of claim 59 wherein said user requests said summary with a 
browser, 

61 (currently amended). A method of providing video comprising: 

(a) a service provider remotely located from a user storing a summary of a video 
that includes baseball; and 

(b) said service provider providing said summary in the form of streaming video 
to a r e mot e said user that is interconnected to said service provider by a network, in response to 
receiving a request for said summarv from said femete user. 

62 (original). The method of claim 61 wherein said user requests said summary with a 
browser. 

63 (currently amended). A method of providing video comprising: 

(a) a service provider remotelv located from a user storing a description of a 
summary of a video that includes baseball; and 

(b) said service provider providing said description to a r e mot e said user that is 
interconnected to said service provider by a network in response to receiving a request for said 
summarv from said r e mot e user. 

64 (original). The method of claim 63 wherein said user requests said description with a 
browser. 

65 (previously presented). A method of processing a video comprising: 

(a) generating a summary of said video comprising a plurality of segments of 
said video, where each of said segments includes a plurality of frames; 
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(b) providing a TV- Anytime compliant description scheme of said video; 

(c) associating a portion of said description with a first one of said segments; and 

(d) associating another portion of said TV- Anytime compliant description 
scheme with a second one of said segments. 

66(canceled). 

67(canceled). 
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